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In recent time the problem of the useful signal extraction from a noise 
becomes the question of the day. A simple example comes from the audio 
signal processing. When processing a piano signal y(n) the sinusoidal com- 
ponents make it difficult to detect the nonstationary mechanical noise 77 (n) 
produced by the hammer hitting the cords. One of possible ways to get rid 
of the noise 77(71) is to decompose the signal y(n) modeled by 

y(n) = tp(n) + rj(n) (1) 

into harmonic and noise parts. Mathematically this is performed by project- 
ing the signal y(s) onto the signal and noise subspaces respectively. 
In this example we use a simple additive uncertain model 

SIGNAL=USEFUL SIGNAL + NOISE 

but in general case the signal may have more complicated structure. In this 
talk we deal with the useful signal <p modeled by the state of the linear model 

I«P = f (2) 

while the measured signal y is supposed to be a sum of the noise 77 and a 
linear transformation of the useful signal Hip 

y = H(f + r] (3) 

We suppose here that / is unknown and belongs to the given set G. Here 
G describes a type of uncertainty. Another source of an uncertainty is rep- 
resented by the measurement noise 77. The problem of the useful signal 
extraction is 



to estimate a transformation £(cp) of the state <p through an 
algorithm £(ip) operating on y. 



A state estimation framework for the linear dynamic models has several 
unlike widely-used approaches: if 2 /-^oo filtering, set- valued state observation 
and minimal guaranteed-cost (or minimax) estimation. i7 2 -estimators like 
Kalman or Wiener filters give the estimators of the signal generating process 
with minimum error variance also known as minimum variance filters. The 
optimal ifoo estimators minimize the norm of the operator that maps the 
unknown disturbances to the filtered errors. A set-valued estimators like 
Kurzhanskii's ellipsoidal informational sets observers describe a set of all 
possible realizations of the state ip consistent with measurements y. 

In this talk we address the linear state estimation problem stated in terms 
of the minimax estimation framework: 

optimal linear algorithm £(cp) minimizes the worst case 
distance sup^ d(£((p), £(<p)) 

In the sequel the optimal algorithm £(ip) is reffered to as a linear minimax 
estimation. 

If the noise 77 is modeled by a random process then we apply a linear 
minimax a priori estimation approach. For the given estimation £((p) = 
(u, •) + c we assign the worst mean squared distance 

<t(£,u):= sup M(%)-%)) 2 (4) 

and set 

e&) = (u,y) + c (5) 
where (u, •) + c has the minimal worst mean squared distance 

a(£) := a(£,u) = mfa(£,u), (6) 

u,c 

The minimal worst mean squared distance &(£) is called a minimax a priori 
error. One can observe that the minimax a priori estimation approach is 
focused on the minimax approximation of a linear function £(</?) on the convex 
set L~ 1 (G) by means of an affine function u(y). 



If the noise n has a deterministic nature we apply a minimax a posteriori 
approach. Its key idea is a geometrical one: the linear minimax a posteriori 
estimation in the direction £ is a map which takes the perturbed information 
y to the center of the interval £(G y ), 

G y = {<p:(Lip : y-H<p)e&} (7) 

thus minimizing the worst case distance 

P (<p) = fm P \(e,<p)-(e,i>)\ (8) 

The number 

fW:=p(<p)=m£p(<p) (9) 

is called a minimax a posteriori error in the direction £. Observe, that a 
posteriori estimation approach is not applicable if the noise r] is modeled by 
a random process with unknown but bounded correlation operator. 

Note that a key feature of the presented state estimation approach 
may be described as follows: we fix a class of linear operators L, 
H; given any pair L, H from that class we describe a class C of all 
solution operators £ such that the minimax error is finite. This allows 
to extend minimax estimation approach developed by Alexander Nakonechny 
to the general class of linear differential-algebraic models 

j t Fx(t) = C(t)x(t) + fit), Fx(t ) = / , 
y(t) = H(t)x(t) + r](t),t < t < T 



with uncertain parameters / , /(•), r)(-). 



Now let us show some results for that case when L is closed linear operator 
which maps the linear dense subset &{L) of Hilbert space H into Hilbert 
space H G Sf(H,y). 
Assumption 1 

the sets R(L), H(N(L)) are closed 

Assumption 2 

the set R(T) = {[Lx,Hx],x G 9{L)} is closed 

Theorem 1 Let 

G = {/ G T : (Q 1 f, f)<l},ve{ V : M(Q 2V , V )<1}, (11) 

and suppose that Assumption 1 or 2 holds. Then the minimax a priori error 
a(£) is finite iff 

£ G R(L*) + R(H*) (12) 
In this case a(£) = (£,p)% and the unique minimax a priori estimation is 
given by £(ip) = (u, y) where u = Q2HP, p is any solution of the equation 

L*z = £ - H*Q 2 Hp, 

_i (13) 
Lp = Q 1 z 

Theorem 1 is based on the general duality principle 
Theorem 2 Suppose that 77 G {77 : M(Q 2 rj,rj) < 1}, £ G i?(L*) + #(#*), G 
is a convex closed bounded subset of T and 

intG n i?(L) ^ (14) 

Then the minimax a priori estimation problem 

sup M(%) -%)) 2 -> inf 

is equal to the optimal control problem 

w) + inf{c(^, z)|L*z = £ — — > min 

For instance Teorem 2 gives Kalman's duality theorem for linear ordinary 
differential equations. Note that there exist a number of examples showing 
that Condition ([T4"]) is significant. 



Let's consider a posteriori estimations. 
Theorem 3 Let 



G = {(f,v):(Q 1 f,f) + (Q 2 r ] ,r ] )<l}, (15) 

and suppose that Assumption 1 or 2 holds. Then the minimax a posteriori 
error d(£) in the direction £ is finite iff 

£ G R(L*) + R(H*) (16) 

In this case 

p(£) = (l-(Q 2 y,y-Hp))h(£) (17) 
and minimax a posteriori estimation is given by 

e&) = (e,<p) = (a,y) (is) 

where ip is any solution of the equation 



L*q = H*Q 2 (y-H<p), 
Lip = Q^q 



(19) 



If d(£) < +oo for any £ then 



inf sup \\p — x\\ = sup \\0 — x\\ = (1 — (Q 2 y, y — H<fi)) 2 max a(£) (20) 
f^Gy xeG x< z G \\e\\=i 



so that ip is the center of the a posteriori set G y . 
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To apply the general theory to the minimax state estimation for ffTUl) we 
need to translate ffTUl) in operator language. We say that x(-) satisfies ffTUj) 
if t i — s- Fx(t) is totally continuous function, Fx(to) = fo and its derivative 

t I— > —Fx(t) almost everywhere on [to,T] is equal to i i — > C{t)x{t) + fit). 

Denote by Wp the space of all x(-) G L 2 [io, ^] such that t i— > Fx(t) is totally 
continuous function. Let X> be the map which maps Wp into L 2 [t ,T] x M n 
by the rule 

Pa;(t) = (j Fx (t) ~ C(t)x(t), Fxfo)), x G Wj? 
We prove that Z> is closed, its adjoint £>* is defined by the rule 
V*(z ,z)(t) = -j/'z{t) - C'(t)z(t), (z,Zo) G W F ,, 
where W F > = {{z,z ),z = F + Fz{t ) + d, F'd = 0,F'z G W£[t ,T]}. 



Lemma 1 Let L'C(t)R' = (g g), where 
F = LAR,F + = R'A + L',LL' = E m ,RR' = E n ,A=( n Di <W) (21) 



If 



sup \\(e 2 E + C' A C A )- x C' 2 \\ mod < +00, 

l>e>-l 



then T> has a closed range. 

Now we can apply Theorems 1,2,3 to the minimax estimation of the inner 
product 



rT 

£(x) = I (£,x)dt 



t 



for the descriptor model ( flOl) . 
Proposition 1 Let 



% = {R V : I tr{Q 2 {t)R v {t, t))dt < 1}, R v {t, s) = Mij'(t)rj(s) 

rp (22) 

= {(/(•). fo) ■ (Qo/o, /o) + / {QiWffl, f(t))dt < 1} 



Suppose that H(N(V)) is closed set, where Hx(t) = H(t)x{t). Under the 
condition (*) we have 

u{t) = Q 2 (t)H(t)p(t), a\u) = [ T (i(t),P(t))dt, (b) 

J t 

where 

jF'z{t) = -C'(t)z(t) + H'(t)Q 2 {t)H(t)p(t) - lit), 

j t Fp(t) = C(t)p(t)+Q^(t)z(t), ( 23 ) 
F'z{T) = 0, Fp(t ) = Q \FF + z(t ) + d),F'd = 



Lets consider a posteriori estimations. 
Proposition 2 Let 

G = {(f,v)-- f T (\\f(t)\\ 2 + \\v(t)\\ 2 )dt<l} (g) 

J to 

Then for any I the minimax a posteriori estimation of 

£(x) = [ (£,x)dt 



by observations 
is given by 

where 
and 



to 



y(t)=x{t)+r)(t),t <t<T 

£{x)= f (£,x)dt (d) 

J t 



£(t) = [xi(t),x 2 {t)] 



(24) 



Xl (t) = (d - C 2 (E + C' 4 C 4 )- 1 C' 4 C 3 )x 1 (t)+ 
(C 2 (E + C' 4 C 4 )- 1 C' 2 + E)q 1 (t) + 
C 2 (E + C' 4 C 4 )- 1 y 2 (t),x 1 (t ) = J 
qi (t) = (-C[ + C' 3 C A (E + C' 4 C A )- 1 C' 2 )q 1 (t) + 
C' 3 C 4 (E + C 4 C 4 y 1 y 2 (t)-y 1 (t) + 
(C' 3 (E - C 4 (E + C'iC^C'JCa + E)x 1 (t), q x {T) = 0, 
x 2 (t) = —(E + C 4 C 4 y 1 C' i C 3 x 1 (t)+ 
{E + C' 4 C A )-\C' 2 q 1 {t)+y 2 {t)), 
q 2 (t) = —(E - C,(E + C'tC^CtiCaXitt)- 
C A (E + C' i C i )- 1 (C' 2 q 1 (t) +y 2 (t)) 

In this case we can estimate the whole state vector of ffTUj) with no assump- 
tions about structure of ffTOl) matrices. 
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Consider a linear time- variant system described by the following discrete- 
time descriptor model 

F k+1 x k+1 -C kXk = f k ,F oXo = q , ^ 
y k = H k x k + g k , k = 0, 1, . . . , 

We assume that system input, measurement noise along with initial condition 
belong to the given set 

G = {(q,{fk},{9k}):G(q,{f k },{g k })^l} 

where 

oo 

G(q, {/it}, {g k }) = (Sq, q) + ^(SJi, fc) + (R^, g t ), 

o 

Theorem 4 For the minimax a posteriori error &(£, N) in the direction i to 
be finite it is necessary and sufficient to have 

Q + N Q N £ = l (26) 

Under this condition we have 

a(£,N) = [l-a N + (Qj,r N ,r N )^(Q+£,£)^ (27) 

and 

(£~^) = (e,Q+r N ) (28) 

where 



Qk — H' k R k H k + F' k [S k -i — S k -iC k -iP k _ 1 C' k _ l S k -i\F k , 
Qo — FqSF + H'qRqHq, P k = Q k + C' k S k C k 



(29) 



k I— > r k denotes a recursive map that takes each natural number k to the 
vector 

r k = F^Sk^Ck^P^ijTk-! + H' k R k y k , 
r = H' R y 

and 

an = Oi-i + (RiVi, yi) - (P^n-i, ^ 
"o = (Sg,g) + (R y ,y ) 



Observe that 

(WW = o if (i-QkQ N )e = e 

In this case 

£(%) = [-00, +00] 

and the estimation algorithm gives the "center" of the real line or trivial 
estimation. Thus we can say that 

the state xn is observable in the direction £ iff 

£ e R(Qn) 

In other words we can assign nontrivial estimation (£,xn) to the projection 
of the state xjy onto the direction £ e R(Q N ). 

Definition 1 The map iV 1— > 7jy = rankQN is called an index of noncausality 
of the model 

Fk+iXk+i — CkXk = fk, F xq = q, 
y k = H k x k +g k ,k = 0,l,..., 

The index of noncausality In gives the number of linear independent observ- 
able directions in the system state space. If it is equal to the state space 
dimension we say that the system ( J25l) is causal. 



Now we reveal the relation between the set-valued estimation approach 
and the minimax a posteriori estimation method. Let ttn be the map which 
takes each vector x = (x\ . . . xn) to its iV-th component xn, let Xi(N) be the 
i-th eigenvalue of Qn- Denote by Pn the set- valued map which takes each 
natural N to the set Pn of all isl™ such that x = 7Tjv where {x/c}^ 
satisfies 



for some q, {fk}o > {9k}o ■ O ne can see that -P/v is a vertical section of 
the model (l25l) trajectories set in the system state space consistent with the 
measured signals (yi ■ ■ ■ Vn)- Now we present an efficient description of Pn 
and its center for the causal descriptor model (1321) . 
Proposition 3 Suppose In = n. For any natural iV 



Pk+lXk+l — CkXk — fk, FqXq 

Vk = H k x k + gk, k = 0, 1, . . . 



(32) 



P N = {x E R n : (Q N x, x) - 2(Q N x N , x) + a N ^ 1} 



(33) 



and 



min max ||x — x 

x£Pm x£Pm 



[1 - a N + (QnXn,xn)] 2 



(34) 



max \\x — Xn 



min^A^AO} 



i 



so that the central point of Pn is given by xn = Q N r N- 



Zhuk S.M., "Recursive state estimation for noncausal 
discrete-time descriptor systems under uncertainties", 
Automatical in press, http://arxiv.org/abs/0711.1334 



